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Method and apparatus for multi-channel acoustic echo cancellation 



(57) In a multi-channel acoustic echo cancellation; 
received signals in a plurality of channels are radiated 
as acoustic signals by a plurality of loudspeakers! 
received signal vectors in these channels are combined 
into a combined vector and a rean^nged received stg^ 
nal vector In the case of at least two channels being 
exchanged is generated. By inputting *ie combined 
received signal vector into an ^ho replica generating 
part which sirruilates echo paths from the loudspeakers 
to at least one microphone, an echo replica is gener^ 

FIG. 7 

Xf(k) 



ated. The echo replica is subtracted from an echo out- 
put from the microphone to obtain a residual echo. 
Based on the relationship between the received signal 
vector and the con-esponding residual echo and 
between the rearranged received signal vector and the 
conespondlng approximated resklual echo, an adjust- 
ment vector is obtained which is used to adjust the esti- 
mated echo path vector representing an impulse 
response of the echo repltoa generating part. 
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Description 

BACKGROUND OF THE INVENTION 

5 Tlie present invention relates to a method and apparatus for multi-ciiannel acoustic echo cancellation which cancel 

room echoes which would othenwise cause howling and present psycho-acoustic problems in a teleconference system 
with a multi-receive-channei system. 

There have been proposed echo cancellers with a view to offering a hands-free telecommunication system which 
is excellent In double-talk performance and is almost free from the influence of echoes. 

10 A description wilt be given first, with reference to Fig. 1 . of a conventional method and apparatus for one-channel 
acoustic echo cancellation. In the hands-free telecommunication, there are two cases where the received signal pro- 
vided at a received signal Input terminal 1 1 is reproduced Intact by a loudspeaker 12 and where the received signal is 
reproduced by the loudspeaker 12 after being subjected to some processing by a received signal processing part 13 
which automatically controls Its gain in accordance with the amplitude, power or the like of the received signal. On this 

IS account, the received signal Xi(k) mentioned herein is not limited specifically to the received signal itself from the per- 
son talking at the other end but also Indicates the processed received signal when the received signal processing part 
13 is provided, k represents a discrete time index. An echo canceller 14 cancels an echo yi(k) which is produced when 
the received signal x^{k) from the loudspeaker 12 Is picked up by a microphone 16 after propagating over an echo path 
15. The echo y^(k) can be modeled as a signal which can be obtained by the following convolution with the impulse 

20 response of the echo path 1 5 at time k represented by h^ ■, (k.n) : 

yi(k) = i:hii(k,n)xi(k-n) * (1) 

where L indicates the summation from n=0 to L-1 , L being the number of taps, which is a constant preset corresponding 
2s to the revertDeration time of the echo path 1 5. In the first place, received signals (k) at times back to L-1 are stored in 
a received signal storage/vector generating part 17. The received signals thus stored are output as a received signal 
vector Xi(k). which is given as follows: 
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x,(k) - [x,(k),x,(k-l),-..,x,(k-L+l)f (2) 



where (*)*'" indicates a transpose of vector. An echo replica generating part 18 calculates the inner product of the 
received signal vector x^{k) of Eq. (2) and an echo replica vector hii(k) obtainable from an echo path esHmatina oart 
35 19 as follows: 

y,{k) =.fiL(k)x,(k) (3) 

40 As a result, an echo replica y i{k) is generated. This inner product calculatfon is equivalent to such a convolution as Eq, 
(1). The echo path estimating part 19 generates the echo replica vector hii(k) that is used in the echo replica gener- 
ating part 18. The most common algorithm for this echo path estimation Is the NU^S (Normalized Least Mean Squares) 
algorithm. With the NLMS algorithm, the received signal vector x^{k) at time k and a residual echo ei(k). i.e. the follow- 
ing enor obtained by subtracting the echo replica from the output of the microphone 16 with a subtractor 21 . 

ei(k) = yi(k)-9i{k) 

are used to calculate an estimated echo path vector hii(k+1) which is used at time k+1 , by the following equation: 
fi|,(k+l) - fi„(k) + ae,(k)x,(k)/{x|(k)x,(k)} (5) 

where a is called a step size parameter, which is used to adjust adaptation within the range of 0<a<2. By repeating the 
above processing, the echo path estimating part 19 is allowed to gradually converge the estimated echo path vector 
55 h 1 1 (k) toward an echo path vector hi ^ (k) which has, as its elements, a time sequence of impulse responses h^ i(k,n) of 
the true echo path 1 5 given by the following equation: 
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- [h„(k,0),h„{lc,l), -.h„(k,L-l)f (6) 

5 As the result of this, the residual echo ei(k) given by Eq. (4) can be reduced. 

In general, a teleconference system of the type having an N(^)^eceive-channGl system and an M/^1)^Jic^<uD- 
channel system employs, for echo cancellation, such a configuraf on as shown in Fig. 2. That is. an echo cancellation 

system 23 is implemented in which N-channel echo cancellers 22,. 22, 22^ for processing N^rSs^nt^ut 

time sequence signals are each connected between all the N channels of the receive (loudspeaker) side and one chan- 

10 nel of the pickup (microphone) side. In this instance, the echo cancellation system 23 has a total of N x M echo oaths 

22m. which are each connected between 

all of the N channels of the recave side and one channel of the pickup side, have such a configuration as depicted in 
Fig 3 which IS an extended version of the configuration of the echo canceller 14 shown in Fig. 1 . This is de^ribed in 
detail, for example, in B. Widrow and S.D. Steams, "Adaptive Signal Processing." Prince-Hall, Inc.. pp 198-200 (1985) 

»5 Now. consider the N-channel echo canceller 22„ having its pickup side connected to an m-th (where lansM) pickup 
channel. The echo ym{k) which is picked up by the m-th channel microphone 16m is created by adding together rLjec- 
tive received signals of all receive channels at the pk*up side after propagation over respective echo paths lT 
through 15„„,. Hence, it is necessary to devise how to make the echo path estimation by evaluating only one residu^ 
echo e„(k) in common to all the channels. In the first place, for the received signal x„(k) of each channel the followina 

20 received signal vectors are generated in the received signal storageA/ector generating parts 17i iTg '17^- 



x,(k) - [x,(k).x,(k-l),.-..x,(k-L,-i-l)f (7) 
2s X2(k) - [Xj(k).Xj(k-l),...,Xj(k-L, + l)f (8) 
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XnC^) - [xN{k).XN(k-l),...,x„(k-LN+l)f (9) 

where L,, .... Ln are numbers of taps, which are constants preset in correspondence with the reverberation times of 
tne ecno paths IS^^. ISg^ ^S,^„. The vectors thus generated are combined in vector combining part54 as follows: 



X(k) = [x]-(k), xj(k) x5(k)]^ 



(10) 



to?lSt«lfX!Ll2T!S2^'^'^™'^l'"^^^ • • hN,„(k). which are used 

to simulate N echo paths between the respective receive channel and the m-th pickup channel, are combined as fol- 

40 lows: 



h m(k) = i h Im (k), h 2m (k) h (k)J 



(11) 



In the case of using the NISM algorithm, the updating of the combined estimated echo path vector fi„(k) is done > 

follows: mv / < 

h „ (k + 1) = h „ (k)+ ae„ (k) X (k) / { xT (k) x (k) } (12) 



In the echo replica generating part 18„. an echo replica y^(k) for the echo y„(k) picked up in the m-th pickup channel 
by the iblkwving inner product calculation: 

ss 

yro(k) = hili(k)x(k) (13) 
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By combining the vectors in the respective channels into one vector, the flow of basic processing becomes the same as 
in the one-channel echo canceller of Fig. 1. 

Of the shortcomings of the conventional echo cancellation system for application to the teleconference system 
composed of an N-receive-channel system and an M-pickup-channel system, the shortcoming that the present inven- 
5 tion is to solve will be described with respect to a concrete example. 

In the application of the conventional echo cancellation system to a two-channel stereo teleconference system 
which sends and receives signals between points A and B over two channels as shown in Fig. 4, there arises a problem 
that each time the speaker at the point A moves or changes, acoustic echoes from the point B by the speech at the point 
A increases even if the echo paths on the part of the point B remain unchanged. This prot^lem is created by an incorrect 
10 echo path estimation in the echo cancellation system on the part of the point B. 

To explain this problem, attention is paid to the operation of an echo canceller 22bi connected to a first pickup 
channel which is one of echo cancellers of two channels forming the echo cancellation system at the point B. To clarify 
the operation of each receive channel, each element of the afore-mentioned combined vector which corresponds to one 
of the receive channels will hereinafter be identified in distinct form. Let x^(k) and X2(k) represent received signal vee- 
rs tors in the two channels at the point B side. Letting echo path vectors of true echo paths 15i i and ISgi of the receive 
channels be represented by hii(k) and h2i(k), respectively, an echo yi{k) which is picked up via the echo paths IS^ 
and 1521 given by 



20 



y , (k) = h|, (k) X, (k) + h[, (k) (k) . (14) 

On the other hand, an echo repli^ y i(k) which is generated in the echo canceller 22bi is given by the following equa- 
tion using estiamted echo paths hii(k) and h2i(k) that are generated in the echo canceller 22bi. 

y I (k) = hn (k) x, (k) + h L (k) X2 (k) (15) 
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When the same speaker speaks or utters at the point A. the receievd signal vectors Xi(k) and X2(k) have a very strong 
cross-cori^elation. When the received signal vectors Xi(k) and X2(k) have a constant cross-correlation, the combined 
vector [h ^^ (k), h 21 (k)] as the solution of the following equation exists infinitely, forming a subspace Hx inhrent to the 
cross-correlation between the received signal vectors Xi(k) and X2(k). 

yi(k) = yi(k) (^ej 

On this account, in the case of using such an ordinary iterative error minimization algorithm as the NLMS algorithm, the 
combined vector [h 11 (k), h 21 (k)] converges to a point where the distance from the initial value to the subspace Hx is 
minimum; in general, it does not converge to the trrue value [h Ti (k). h Ji (k)]. 

For simplicity, consider the case where the received signal vectors Xi(k) and X2(k) are expressed by the following 
40 equations using constant scalar values pi and P2 and the original signal vector s(k). 

Xi(k) - p,s(k), Xjik) - P2S(k) (17) 

45 The subspace Hx where the combined vector [fi Ti (k), h 21 (k)] is allowed to exist can be regarded as a straight line in 
Fig. 5 which satisfies the following equation. 



so 
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h 1 1 (k) + P2 h 21 (k) = p, h, , (k) + Pj h^^ (k) f 18) 

When the adaptation starts from the initial value 0, the point of convergence [fi Ti (k), h 21 (k)] is obtained as follows: 
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h„p(k) = p, {h„(k) + P2h2,(k)/p,}/(pf +p|)^ h„(„) 

h2.p(k)=p|{p,h„(k)/p, +h„(k)}/(pf +p|):^ h^,(k) (20) 

Consequently Eq (18) is no longer satisfied upon variation in the rate between the scalar values Pi and Do maWno 
echo cancellaton .nposs-ble and hence resulting in an increase in the acoustic echo returning to the ^e^^er at tSe 

As will be understood from the above, in the application of the conventional echo cancellation system to the tele- 
nateX'^vlfh'jrnrr"''^ ^ N-receive-channel system and an M-pickup-channel systeTreJeivi sig- 
7^^ ^^^ L ♦ T ^ the estimation of echo paths cannot correciy be made-thi^^i 

nse to the problem that the echo increases upon each variation in the cross-correlation between L re^eZ^ZT 

SUMMARY OF THE INVENTinNI 

Jlif r^'^IS'^f " *° « ""^^"^ apparatus for multi^Jhannel acoustic echo 

cancenabon which permit echo cancellation even if received signals have the afore-mentioned cross-<JrSon inme 
conventional mult-channel acoustic echo cancellation system correianon in me 

According to the principle of the present invention, the adjustment vector for the estimated echo path is derived 
through utilization of the '"PUt-output relationships which are actually observable when received Sgr«ls ^ rlpj^ 
channels are input into echo paths after being reproduced intact as acoustic signals by loudspeakeShe irSSSi 
ing channels and the outpute from the echo paths are picked up by each mitJophone. and a^roSi^Lte^ or 
imaginary input-output relationships based on inputs into the echo paths when some or all^thT^SeS sS^s Z 
each channel are «cchanged and reproduced as acoustic signals in a different channel and outpS^fc?^?pS^J3 
up by each microphone as acoustic signals after propagation over the echo paths ^ 
The multi-channel acoustic echo cancellation method according to the present invention comprises the steps of: 

ttlrcSJ^'n^^nX^to"''''^'''""''^ 

j^vsrc2:^a:rr:reicr "^-^'"^ - 

(c) storing the received signals of the plurality of channels for predetermined periods of time and fbrmino received 
signal vectors by the stored received signals for each channel- rornmng received 

(d) combining the reived signal vectors in all the channels irito obsen«ble combined received signal vectors 

ScSri* iZ?rf ""^^ *° estim'ati :So path 

^^^t^T *° ""f'"^ ^^^-^ °' «<=ho path vectors represented by impulse responses of *e 
respecbveecf^o paths, whereby is generated an echo replica simulating the observable echo, combined 

t;™y:fe^^^^^^ 

(f) subtracting the echo replica from the echo to obtain a residual echo- 

(g) calculating an approximated echo replica in the case where confined exchanged received signal vectors 
obtained when at least two received signals of the plurality of channels, are providedTo the estimati StoSSt^ 

(h) approximating an echo which ought to be obtained by each microphone when the received slgnalstxcha^ 
as in step (g) propagate thereto over the plurality of echo paths- excnangea 
W s^Ltostracting the approximated echo replica from the approidmated echo to obtain an approximated residual 

0) evaluating observable input-output relationships representing the relationships between the observed combined 
received signal vectors and the corresponding observable residual echo and approximated input-output rSaJ^- 
shi^representing the relationships between the combined exchanged received signal vectore andVhe appraS- 
mated residual echo and obtaining the adjustment vector based on the evaluation- and 
(1^ adjusting the estimated echo path vector by the adjustment vector. 

The multi-channel acoustic echo canceller according to the present invention comprises: 

IHT^ t ^ reproducing received signals in a plurality of channels into acoustic signals and for 

ouipuning them; 
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a microphone connected to at least one transmission channel, acoustic paths of the acoustic signals from the plu- 
rality of loudspeakers to the microphone forming echo paths and the acoustic signals picked up by the microphone 
and conr^ined into an echo for input into the transmission channel; 

a received signal vector generating part for temporarily storing the received signals of the plurality of. channels and 
5 for generating each received signal vector; 

a vector combining part for combining the received signal vectors of the plurality of channels into combined 
received signal vectors; 

an echo replica generating part supplied with the combined received signal vectors and combined estimated echo 
path vectors simulating the combined echo path vectors obtained by combining echo path vectors representing 
10 impulse responses of the echo paths from the plurality of loudspeakers to the microphone, for outputting an observ- 
able echo replica simulating the echo; 

a subtractor for subtracting the echo replica from the echo output from the microphone and for outputting the differ- 
ence as an observable residual echo; 

a vector permuting/combining part for generating combined rearranged received signal vectors obtained by com- 
15 bining the received signals of the plurality of channels after rearranging at least two received signals of the plurality 
of channels; and 

an echo path estimating part supplied with at least the observable combined received signal vectors and the 
observable residual echoes corresponding thereto, for obtaining approximated echo replica in the case of applying 
each of the combined received signal vectors to one of the estimated echo paths, for obtaining as an approximated 

20 echo the echo to be obtained from the microphone in the case of the received signals being exchanged, for sub- 
tracting the approximated echo replica from the approximated echo to obtain an approximated residual echo, for 
evaluating an observable input-output relationship representing the relation between the combing received signal 
vector and the observable residual echo corresponding thereto and an approximated input-output relationship rep- 
resenting the rearranged combined received signal vector and the approximated residual echo corresponding 

25 thereto, for obtaining the adjustment vector on the basis of the evaluation, for generating an estimated echo vector 
obtained by adjusting the estimated each path vector with the adjustment vector, for providing it to the echo replica 
gengenerating part. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

Fig. 1 is a block diagram showing a one-channel echo canceller; 
Fig. 2 is a block diagram showing a multi-channel acoustic echo cancellation system; 
Fig. 3 is a block diagram showing a conventional multi-channel echo canceller; 
Fig. 4 is a block diagram showing a stereo telecommunication system: 
35 Fig. 5 is a graph showing an echo path estimating operation which is carried out when received signals have a 
cross-correlation; 

Fig. 6 is a diagram illustrating an example of a symmetrical anrangement of microphones and loudspeakers in a 
stereo telecommunication system; 

Fig. 7 is a block diagram illustrating an example of the multi-channel acoustic echo cancellation system embodying 
40 the present Invention; 

Fig. 8 is a block diagram illustrating, by way of example, the configuration of the multi-channel echo canceller 
embodying this invention method; 

Fig. 9 is a functional block diagram illustrating the configuration of an echo patti estimating part in Fig. 8; 
Fig. 10 Is a functional block diagram illusfrating another configuration of the echo path estimating part in Fig. 8; 
45 Fig. 1 1 is a functional block diagram illustrating the configuration of an adjustment vector calculating part in Figs. 9 
and 10; 

Fig. 12 is a functional block diagram illusfrating another configuration of the adjustment vector calculating part in 
Rgs. 9 and 10; 

Fig, 13 is a graph showing convergence characteristics of an error between true and estimated echo path charac- 

50 teristics; 

Fig. 1 4 is a graph showing the influence of a weighting coefficient assigned to an approximation enror signal on the 
convergence characteristic of the error signal; 

Rg. 15 is a graph showing the influence of weighting coefficients v-i, V2, w^. W2. orders pi. p'^, p'2 and step sizes 
Ri» ^2 on tiie convergence characteristic of the echo path estimation; and 
55 Fig. 16 is a block diagram illustrating a teleconference system which is equipped with a sound image localization 
function in a four-point communication. 
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DESCRIPTION OF THF P REFERRFD FIVIBODIMgrMTR 

PRINCIPLE 



To facilrtate a better understanding of the present invention, its principle will be described first in connection with a 
two- ecen/e-channel system for the sake of brevity. As described previously with reference to Figs 4 andTS^e^ ttie 
received signals Xi(k) and x,(W) are reproduced, then propagate over the corresponding echo paSs hlTk) aiS^^lTw 
San"ceK"enrfo,^^^° '"P--^- — Tp^^S 



instance is given as follows: 

y™ (k) = hj„ (k) X , (k) + hL (k) (k) (21) 



When the cross-correla^on between the received signal vectors x,(k) and x^k) is constant, it is impossible to uniquely 
determine estimated echo path vectors h ,„(k) and h2,(k) which satisfy the relationship of Eq. (2^ as referVeS to S 

3S ^""^ ''-^^^ ""^"""^ '""^ P'^^'^P that corre^nds to rieilS signal 

,^wu I^^^ ^ ""^^^^ ^^"""^ ^ cross-correlation different from that between the received signal vectors jTflO arS 
X2(k). the following relationship is obtained as is the case with Eq. (21). eu signai veciors Xi(k) and 

y'™ (k) = h7„ (k) X', (k) + (k) x'2 (k) (22) 

Letting echo replicas for the m-th pickup channel when supplied with the paire of received signals xi(k). x2(k) and x',/k) 
x"2(k) be represented by y„(k) and y'„(k). they are given as fblk>ws. ' ^ ' 

y m (k) = h L (k) x , (k) + h L (k) X2 (k) (23) 
y 'm (k) =hj„ (k) X' , (k) + h L (k) x'2 (k) (24) 

Further, letting error signals between the echoes y„(k). /„(k) and the echo replicas y„,(k). y'„(k) be represented by 
e k) and e' (k). respecjvely and echo path estimation error vectois between the ecS paths hU(k) aS S) aS 

e™ (k) = y™ (k) - y m (k) 

= km (k) - h Im (k)) X , (k) + (h (k) - h L (k)) x^ (k) 

= Ah[„(k)x^(k) + Ah^(k)x2(k) (25) 
e'm (k) = y'„ (k) - y '„ (k) 

= (h]-„ (k) - h L (k)) X', (k) + (hL (k) - & L (k)) x'2 (k) 

= A h[„ (k) X' , (k) + A hL (k) X '2 (k) (26) 

That is, the following relationships are obtained. 
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x|(k) xj(k) 
x'l(k) x'I(k) 



^Ah,„(k) 
lAh2„ (k) 



em(k) 

e'm(k). 



(27) 
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The echo path estimation error vectors Ahin,(k) and Ah2m(k) cannot uniquely be derived from Eq. (27), but letting its 
minimum-norm solutions be represented by Ahim(k) and Ah2m(>^). respectively, the following relationship is obtained. 



(28) 



where (*)"^ indicates a generalized inverse matrix. Thus, the estimated echo vectors him(k) arid h2ni(k) can be adjusted 
using the minimum-norm solutions Ah^m(k) and Ah2m(k) as adjustment vectors as follows: 



'a h im (k) 




Aw 

A h 2in (k) ^ 





xT(k) 


xl(k) ] 




fe.(k) \ 


x'l (k) 


x'J(k)J 




,e'„(k)/ 
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h im (k + 1) = h im (k) + M„Ah im (k) 



(29) 



h 2m 



(k + 1) = h 2m (k) + 



,Ah2m(k) 



(30) 
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where jJim is a step size parameter. In this case, the adjustment vectors Ai^fiW and AhgmM are allowed to have a 
cross-correlation different from that between the received signals xi(k) and X2(k), and hence it is possible to estimate 
the characteristic of the true echo path independently of the cross-correlation between the received signals. However, 
the above discussion presupposes that the input-output relationship for the received signals x'i(k) and X2(k) having a 
cross-correlation different from that between the received signals x^(k) and X2(k). expressed by Eq. (22), could be 
observed. In practice, this input-output relationship is unknown. The present invention utilizes the condition in which this 
input-output relationship is approximately satisfied. 

It is possible to use, as the received signals x\{k) and x'2(k). arbitrary signals having a cross-correlation different 
from that between the received signals xi(k) and X2(k). Now, to approximately satisfy the input-output relationship given 
by Eq. (22), consider the case where received signals of two channels are exchanged or reversed and reproduced as 
follows: 



x*i(k) = X2(k) 
x'2(k) = xi(k) 



(31) 
(32) 



That is. when the cross-con-elation between the received signals x^{k) and X2(k) is 1 :2. for instance, the received signals 
x'i(k) and x'2(k) resulting from the channel exchange have a different cross-correlation 2:1. Accoiding to the present 
invention, when received signals of multiple channels are reproduced, an adjustment vector Is obtained by solving the 
combination of exchanged or reversed received signals of two channels as shown by Eq. (28). A description will be 
given of several methods for obtaining the adjustment vectors Ahim(k) and Ah2m(k) on this principle. 

METHOD 1 

Method 1 uses different weights to evaluate the observable input-output relationship expressed by Eq. (21) and the 
input-output relationship of Eq. (22) which is inferred to be approximately obtained by the signal exchange based on 
Eqs. (31) and (32). For example, error signals em(k) and e ^(k) are evaluated with different weights. This weighting is 
divided into two: a fixed, time-invariant weight and a time-varying weight. 

Method (1-a) 

For example, in the case of a two-receive-channel system, the adjustment vectors are obtained by introducing 
weigthing coefficients Ym and to evaluate the enrors e^CK) and e'm(k) in Eq. (27) with different weights and solving 
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the following equation. 







(k)l 








x'J(k)/ 




(k)] 




1 





(33) 
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Method (1-b) 



The error e'm(k) is separated tnto a component are correlated with the error arxJ a component decorralated 
therewith and then weighting coefficients are introduced. For example, noting the correlation between received signals 
IS the signals x'i (k) and x'gCk) can be separated into a portion correlated with the received signals Xi(k) and X2(k) (second 
term on the right-hand side of Eq. (34)) and the other portion (first term on the right-hand side of Eq. (34)) as expressed 
as follows: 



20 


'x',(k)1 




/x',(k)l 


_ r'(k) 




x'jCk)] 




lx'2(k)j 


r(k) 





, + r' (k) 


/x,(k)l 




r(k) 





r* (k) = x| (k) X', (k) + xj (k) X' (k) 



25 



(34) 

(35) 
(36) 



r (k) = x| (k) X, (k) -f xl (k) (k) 

30 Further, by multiplying the both sides of Eq. (34) by [AhT„, (k). AhL (k)] from the left-hand side and using the relation- 
ships of Eqs. (25) and (26), the enror e'mdO becomes as follows: 

e'Jk). 



35 



= {e'.(«^-^e„(k)|.t^e„(k) 



(37) 



From the viewpoint of the correlation between the received signals, the en-or e'^k) is separated into the component cor- 
related with the en-or e„(k) (second term on the right-hand side of Eq. (37)) and the other component (first term on the 
■w right-hand side of Eq. (37)). By this. Eq. (27) becomes as follovws: 



4S 



BO 



x|(k) ^2 



xT(k) 



x'|(k) 



00 



Ah,™ (k) 
Ah,™(k) 



e„(k) 



(k)-|^e„(k) 



+ i:(!Oe (k) 
r(k) ^"^''^ 



(38) 



Then, the component of the en-or e'n,(k) correlated with the error and the other component are multiplied by coef- 
55 fidents v and w independentiy. by which Eq. (38) becomes as follows: 
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/xy(k) xj(k) \/Ah,„(k) 

[x'[(k) x'J(k)HAh^(k) 



e„(k) 



10 



e„,k)-ll<i>.e„ 
r(k) " 



(k) " 



(39) 



This equation is solved to obtain the adjustment vectors. 

IS As shown by Eq. (39). by separating the error e'm(k) into the component correlated with the error em(k) and decor- 
related conponent and weighting the respective components independently of each other, the resulting adjustment 
vectors match those obtainable with the afore-mentioned NLMS algorithm when setting v=0 and w=1. Further, setting 
v=1 and w=0 has a physical meaning which corresponds to the calculation of the adjustment vectors on the basis of 
that component of the error e'^(k) obtained converning the approximated input-output relationships which is not corre- 

20 lated with the error e^^ik) obtained concerning the ot>servable input-output relationships. 

One possible method that is employed in the case of varying the weighting coefficients with time as mentioned 
above is to vary them in accordance with the degree of convergence of the estimated echo path vector to the true echo 
path vector as will be described later on. For example, in Method (1-a), the weighting coefficient Ym(k) is chosen to be 
equal to 1 and ym(k) smaller than 1, whereas when the degree of simulation of the true echo path is low, the weighting 

25 coefficient fmCk) is chosen to be larger but not in excess of 1 . In Method (1 -b), when the degree of simulation is low, the 
coefficients v and w are set to 0 and 1 , respectively, as in the past, and as the degree of simulation increases, the values 
of the coefficients v and w are varied accordingly. 

To evaluate the degree of simulation, use is made off at least one of the ratio between the echo yn,(k) and the resid- 
ual echo (i.e. error signal) em(k). the average power ratio fc)etween the echo and the residual echo, the absolute value 

30 of the residual echo and the average power of the residual echo. 



METHOD 2 



Next, a description will be given of a concrete method for obtaining the vectors Ahifn(k) and Ah2m(k) in Eq. (28) in 
35 the description of the principle of the present invention or Eqs. (33) and (39) in Methods (1-a) and (1-b). 

Unknown input-output relationships approximated between inputs into echo paths when some or all of the received 
signals of respective channels are exchanged and reproduced as acoustic signals from channels different from their 
original channels and outputs to be produced when the above inputs are picked up as echo signals by microphones 
after propagation over the corresponding echo paths. This approximation is made through utilization of known input- 
40 output relationships actually observed when the received signals Xrn(k) of respective channels are reproduced intact as 
acoustic signals and picked up by microphones after propagating over the corresponding echo paths, the residual echo 
(an error signal) for the evaluation of the input-output relationships and the similarity of the echo paths. This can be 
done by such concrete methods as described below. 

45 Method (2-a) 

This method utilizes the similarity of echo paths on the assumption that equivalent echo paths are fornied between 
loudspeakers and microphones of physical arrangements similar in terms of the distance therebetween and their orien- 
tation. For example, when the receive and the pickup system are both two-channel, the input-output relationships for 
50 the respective pickup channels are as follows: 



ss 



y , (k) = hi, (k) X , (k) + hj, (k) X2 (k) 
yj (k) = h|2 (k) X , (k) + (k) Xj (k) 



(40) 
(41) 



Now, supposing that when loudspeakers 12i. 122 B.nd microphones 16i and 16i are anranged bilaterally symmet- 
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rical, including their directional patterns, as shown in Fig. 6, the following equations hold 
hii(k) = h22(k) 
h2i(k) = hi2(k) 



(42) 
(43) 



From these equations and Eqs. (40) and (41). the following relationships can be derived. 

10 

y'l (k) = h7, (k) X2 (k) + hj, (k) X , (k) = (k) 
y'2 (k) = h]2 (k) X2 (k) + (k) X, (k) = y, (k) 



IS 



(44) 
(45) 



These relationships are indeed the input-output relationships which are obtained when the receive channels are 
exchanged: hence, e'i(k)=e2(k) and e'2(k)=ei(k) hold. By applying these approximated results to Eqs. (28). (33) and 
20 t39) as well as (44) and (45). three metHdds could be obtained as described below. 

Method (2-a-1) 

By applying the channel exchange and the echo path approximation to Eq. (28), the fbllowhig simultaneous equa- 
2S tionsareobtained, and by solving Eq. (46), the adjustment vectors can be obtained. 



30 



A h'nCk) 




'x7(k) 


xj(k) 0 


0 


ei 


(k)" 


A h2,(k) 




xj(k) 


xT(k) 0 


0 




(k) 


A h,2(k) 




0 


0 x7(k) 


xj(k) 


62 


(k) 


. A h'22(k) . 




0 


0 xj(k) 


x|(k) 


.^1 


(k) 



(46) 



40 



45 



SO 



SS 



Method (2-a-2) 

By applying the channel exchange and the echo path approximation to Eq. (33). the following simultaneous equa- 
tions are obtained, and by solving Eq. (47). the adjustment vectors can be obtained. 



x|(k) xj(k) 0 0 
xj(k) x[(k) 0 0 

(47) 

0 0 x7(k) xj(k) 
0 0 xj(k) xj(k) 



A h „(k) 




YieKk) ■ 


A h 2,(k) 




Y'.e2<k) 


A fi',2(k) 




Y2e2(k) 


> h22(k). 




.Y'2e,(k) 
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Method (2-a-3) 

Setting c(k)=Y'(k)Y ^ (k) and applying the channel exchange and the echo path approximation to Eq. (39), the fol- 
lowing simultaneous equations are obtained, and by solving Eq. (48), the adjustment vectors are obtained. 



10 



IS 



20 



25 



x|(k) xj(k) 0 

xj(k) x7(k) 0 

0 0 

0 0 



0 
0 



x[(k) xj(k) 
xj(k) x]"(k) 



A hii(k) 
A h2i(k) 
A h i2(k) 

LA h22(k) 



e,(k) 

V, {e2(k)-c(k)e,(k)} +w,c(k)e,(k) 

e^Ck) 

{ e ,(k)-c (k) e2(k) } + w^c (k) ej(k) 



(4«) 



30 Method 2-b) 

Another method (2-b) is one that can be used even if the afore-mentioned assumption in Method (2-a). for example, 
the assunption ttiat the echo paths between loudspeal<er and micraphones of similar physical arrangements are the 
same, as in the case of Eqs. (42) and (43), does not hold with high accuracy. When the receive and the pickup system 
35 are both two-channel as is the case with the above, the following equations are used in place of Eqs. (42) and (43). 



40 



liii(k) = h22(k) + fi(k) 
h2i(Jc) = hi2(k) + f2(k) 



(49) 
(50) 



where f i(k) and f2(k) represent a similarity en-or between the true echo path vectors hii(k) and h22(k) and a similarity 
error between the true echo path vectors hf2(k) and h2i(k), respectively. On the other hand, a similarity error f i(k) 
4S between the estimated echo path vectors hii(k) and h22(k) and a similarity en-or f2(k) between the estimated echo 
path vectors Iii2(k) and fi2iO^ are expressed as follows: 



so 



fi,,{k) - fi,,(k) + t,(k) 



(51) 
(52) 



Further, the differences between the similarity errors of the true and estimated echo paths are defined by the following 
55 equations: 
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Af,(k) -f,(k) -f,(k) ^53) 
Af,(k) -f,(k) -fj(k) (54) 

These differences will hereinafter be referred to as similarity error differences. Then, letting y\ik) and y be outputs 
which are obtained in the first and second pickup channels when reproducing the received signals x,(k) and Xofk) after 
exchanging the receive channels, the following equations are obtained using the relationships of €qs. t49) ISO) and 
10 Eqs. (40). (41). ' 

y' , (k) = hi, (k) xj (k) + hj, (k) X , (k) 

= y2 (k) + f I (k) X 2 (k) + f J (k) X , (k) (55) 
y'2 (k) = h]2 (k) X2 (k) + (k) X , (k) 



IS 



= y,(k)- f[(k)x,(k)-fT<k)x2(k) 



20 



(56) 



The outputs yj(k) and /aCk) are simulated to be y'i(k) and y-2(k) by the fbHowing equations, using the estimated echo 
path vectors hii(k). h2i(k), hi2(k). h22(k) and Eqs. (51). <52). 

y'l (k) = h[, (k)Xj (k) + hli (k)x, (k) 

= y 2 (k) + f [ (k) X2 (k) + f 2 (k) X, (k) (57) 



30 



35 



y'2 (k) = h I2 (k) X2 (k) + h L (k) x, (k) 

= y 1 (k) - f r (k) X , (k) - f r (k) X2 (k) (58) 

Enors e-i(k) and e'2(k) between the outputs y'^(k), y'2(k) and their simulated values yi(k). y'2(k) are given as follows: 
e', (k) = A hu (k) (k) + A h J (k) x, (k) 

= 62 (k) + A f I (k) X2 (k) + A f J (k) X, (k) (59) 



45 



so 



e'2 (k) = A h I2 (k) Xj (k) + A h L (k) x, (k) 

= e, (k) - A f y (k) X, (k) - A f I (k) X2 (k) (60) 



where: 

55 ei(k) = yi(k)-y,(k) 



(61) 



e2(k) = y2(k)-y2(k) 
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A f 1 (k) = f, (k)- f,(k) 
A f 2 (k) = f, (k) - f 2(k) 



(63) 
(64) 



Since the similarity error differences A, f (k) and Af 2(k) are expressed in Eqs. (63) and (64) as unknown similarity en-or 
w vectors fi(k) and f2(k). respectively, the errors e'1(k) and e'2(k) cannot correctly be known. Then, solving Eqs. (59) and 
(60) for the known errors e2(k) and ei(k), we have 



75 



ej (k) = A hi, (k) xj (k) + A h L (k) X , (k) 
- A f T (k) Xj (k) - A ?J (k) X, (k) 



(65) 



20 



e, (k) = A fi'Iz (k) X2 (k) + A h (k) x , (k) 



AT 



/ST 



+ A f 1 (k) X, (k) + A f 2 (k) Xj (k) 



(66) 



25 On the other hand, the following equations are obained from Eq. (25). 
e, (k) = A h M (k) x , (k) + A h L (k) X2 (k) 



30 



62 (k) = A h I2 (k) X , (k) + A h L (k) X2 (k) 



(67) 
(68) 



Therefore, the following simultaneous equations are obtained from Eqs. (65) through (68). 



35 



40 



45 



SO 



x]00 xj(k) 0 0 0 0 

xj(k) x|(k) 0 0 -xj(k) -xy(k) 

0 0 x|(k) xj(k) 0 0 

0 0 xj(k) x|(k) x|(k) xj(k) 



A ^ii (k) 
A h 21 (k) 
A h,2(k) 
A ^nOO 



A f 1 (k) 



A f 2 (k) 



e, (k) 
62 (k) 
62 (k) 
e, (k) 



(69) 



55 The adjustment vectors of the estimated echo paths are obtained as minimum-norm solutions of the simultaneous 
equations of Eq. (69). In this case, the similarity error differences Af i(k) and A? 2(k) need not calculated in practice. 
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in, ^.S^X m'^^ on B^m. m. .,.0^ o, m. weigh,. 















A h 11 (k) 






10 


■x7(k) 


xj(k) 0 


0 


0 


0 




A h 21 (k) 




Yie, (k) 




xl(k) 


x[(k) 0 


0 


-Y'l xl(k) 


-y'i x[(k) 




A lii2(k) 




Y'i«2(k) 


IS 


0 


0 x[(k) 


xj(k) 


0 


0 




A h 22 (k) 




Y2 ez (k) 




0 


0 xj(k) 


x]"(k) 


Y 2 x[(k) 


Y'2XJ(k) 




A f I (k) 




. Y'2 e, (k) 


so 












A f 2 (k) 







25 



30 



(70) 

In this instance, the weighting coefficients are applied Ibllowing €qs. (59) and (60) as follows: 

Y'l e'lCk) = Y'l e2(k) + y', A f r(k)X2(k)+ y'i A f I(k)x,(k) (71) 
Y'2 e'2(k) = Y'2 e,(k) - y'z A f [(k)x,(k)- y', A f J(k)x2(k) (72) 



35 



Method (2-l>2) 

40 of i^^ZZ^^^iZf"^ time-im«riart or time-varying weighting coefficients which permit control of the influence 
^ "^^^ receive and picKup systems are both IwoThZ^^! 

evaluation of the afore-mentioned similarity errar differences Af ,(k) and A? ^(k) is weStTwJh rSp^^TTt^r^il^^^ 

i^g?ti™'c::SSt^r*^ ^^-^'^^^ ^^^^ ^ elnr^e'T^^S^IrZ^ETm 

weighting coefficients k,. frg. and A4 as elements by which the similarity eiror differences Af i(k) and Af 2(k). we have 

45 



SO 



65 



15 



EP0766446 A2 



10 



IS 



20 



SS 



x](k) xj(k) 0 0 
xj(k) x7(k) 0 0 - 
0 p x]"(k) xj(k) 



Ki Y'l X2(k) 

0 



0 



0 xj(k) x7(k) K-3Y'2xT(k) 



-1^2 y'l x]"(k) 

0 



Yi e, (k) 
Y'l ez (k) 

Y2 62 (k) 

y'2 e, (k) 



A h n (k) 
A ^21 (k) 



A h 12 (k) 



A h 22 (k) 
A f 1 (k) 
A f 2 (k) 



(73) 



30 In this instance, if ofiii(k)-fi22(k)|/||fii i(k)D is small, then it is inferred from Eqs. (46) and (47) that the similarity error vec- 
tor fi(k) is small; hence, if the atxjve ratio is smaller than a predetermined threshold value K1, for instance, control is 
effected to make the weighting coefficient smaller than 1. for example. Similarly, when ||h2i(k)-hi2(k)Wh2i(k)|| is 
smaller than a predetermined threshold value K2. control is effected to make the weighting coefficient kz smaller than 
1, tor instance. 



35 



40 



Method (2-b-3) 

According to this method, introducing weighting coefficients v1 , V2, w, and W2 tjased on Method (1 -b) into Eq (69) 
based on Method (2-b) and setting c(k)=r'(l^r'^ (1^ , we have 



45 



SO 



SS 
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10 



IS 



20 



25 



30 



35 



x|(k) xj(k) 0 0 0 

xj(k) x7(k) 0 0 -v,xj<k) 

0 x7(k) xj(k) 0 

0 xj(k) x|(k) vjxyck) 



0 
0 



0 

-V, x]"(k) 
0 

V2 Xj(k) 



A ^1, <k) 
A h 21 <k) 
A fi'wXk) 
A h22<k) 



A ^ (k) 
A f 2 (k) 



e,(k) 



V, ( 62 (k) - c(k) e,(k) } + w, c(k) e,(k) 
CjCk) 

vj { e, (k) - c (k) C2(k) } + W2 c (k) CjCk) 



(74) 



By setting the following equations (75) and (76) and solving simultaneous equations (73). tlie adjustment vectors can 
be obtained. 



f (k) = x\ (k) Xj (k) + xj (k) X, (k) 
r (k) = x]" (k) X, (k) + xJ (k) Xj (k) 



(75) 
(76) 



40 METHODS 

A third method derives the adjustment vectors of the estimated echo path vectors by evaluerting. In combination, the 
input-oulput relationships obtained by approximating those observed previously and the input-output relationship 
obtained by approximating those observed at the current time. 



45 



55 



Method (3-a) 



In concrete terms, a projecUdn algorithm is applied to methods (2-a) and (2-b) wrhich utilize the afbre-mentioned 
channel exchange. The projection algorithm is to adjust the estimated echo path vectors so that the input-output rela- 
50 tionships In an n-th received signal channel at the cun-ent and (yevious time p^ are satisfied simultaneously, where p^ 
is an integer that does not exceed the number of taps L of each estimated echo path vector. In the first place, the n-th 
channel received signal vectors from the current time back to the previous time Pn are generically expressed as toiiows: 



Xn<**'(k) = IXn(k), xn(k-l), x„(k-p+l)] (77) 

Again, when the receive and pickup systems are both two-channel, setting enor signals as follows: 
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10 



IS 



er"(k) = 



[e,(k),(l-,*,)e,(k-l) (l-^i,)'"'"' e,(k-p, + l) Y 

ef' = [e2(k). (1 -iU2) eaCk- 1) (1 - CjCk-p' , + 1) ] ' 

e^\k) = [e2(k).(l-^2)e2(k-l) (l-iu^)"^"' CjCk-p^^- 1).] 

e;'''^\k) = [e,(k).(l-^,)e,(k-l) (1- A*.) e,(k-p'2 + 1) ]' 



(78) 
(79) 
(80) 
(81) 



and applying the projection algorithm to Eq. (73), we have 



20 




0 


0 




0 






xl'V^k, 0 


0 






(P',)T 
-KTjY', X, • (k) 


25 


0 


0 




x;''^^'^(k) X 




0 




0 




0 


0 




xr^'^(k) xy\v.) 


'^3 Y'2 


x;''V"(k) 


ic^Y'zXj ' (k) 


30 




A hii (k) 














35 




A h 21 (k) 




(p.) 
Y , e, ' (k) 










40 


X 


A h ,2 (k) 
A h 22 (k) 
A fi (k) 




Y'. e^'^k) 
Y.e^'^V) 
.Y'2er^^k) 








(82) 


45 




. A f 2 (k) . 















Let it be assumed that parameters for determining how far back to the previous time for using the input-output relation- 
so ships can be set independently within the ranges in which they do not individually exceed the numbers of taps L of the 
estimated echo path vectors just like Pi, p'l. pg and p'g which satisfy a condition min{pi,p2}^max{p'i,py. 

Method (3-b) 

55 Applying the projection algorithm using Eqs. (77) through (81) to Eq. (73) based on Method (2^>3) and setting a 
matrix for the cross-correlation as follows: 



Ci(k) = R'(p.,xpoWR'\,xp,)M 
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C5(k)-R'(p.,xp,,<k)R\^,p^,(k) 



(83) 



we have 



10 



IS 



20 



SS 



30 





X?' 




0 


0 


0 




xi"'' 


*\k) 0 


0 




-V, Xf'^^k) 


0 


0 


X i'^^^'^Ck) 


X^'\k) 


0 


0 


0 


0 


X?'^^^k) 




v.X;'''»>V) 


v,X?'^^V) 



X 



A h ,1 (k) 



A h 21 (k) 



A h i2 (k) 



A h 22 (k) 



A ?i (k) 



A f 2 (k) 



V, { e^;'>\k)-C,(k) e^'l'^k)} + w, C,(k)e^V^k) 



vj { e^^' (k)-C2(k) t%'' (k)} + wj C2(k) e'^z^^ (k) 



(84) 

The adjustment vectors are obtained as the minimum-norm solution of tlie aljove simultaneous equation (84). The n-th 
channel received signal vectors tiack to the previous time p are generically expressed as follows: 



40 



45 



50 



SS 



Xn'PMk) - [x„(k),x„(k-l),.-.,x„(k-p+l)] 



(85) 



The parameters for determining how far t>ack to the previous time for using the input-output relationships are set as p, , 
p'l , P2 and p 2, which satisfy the condition min{pi ,p2)amax{p'i jsy and are given as follows: 



R'(p', xp.) 00 = x;''''^V)x?'^(k) + x?''^k)x;'''^(k) 

R'(P'.xp,) (k) =• X?'^^''(k)X^Vk) + X?'=''>)X^^(k) 
R(p. xp.) (k) = X'r'\k)x'r'(i0 + X?'^k)X?-\k) 



R(p^ xp,) 00 = X^^''(k)Xr'(k)+ Xr'"(k)Xi''^'<k) 



.(pj). 



<86) 
<87) 
(88) 
(89) 
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e/'V) = [ei(k).{1.n,)e,(k.1) {1-»ii)'''''e,(k-Pi+1)]^ 

e/'^\k)«[e2(k).(1.K2)e2(k-1) (l-^a)'' '"'egCk-p'i+l)]"^ 



e2^'\k) = [e2(k).(1.^2)e2(k-1) (1-ji2)^'"'e2(k-P2+1)]'' 



e/''''\k) = [e,(k).(1-n,)ei(k.1) O-Mi)*" '"'e,(ki3"2+1)]'^ 



P'2-1 



(90) 
(91) 
(92) 
(93) 



Method (3-b-l) 

IS As is the case with Eq. 84). the adjustment vectors can also be obtained by introducing the time-invariant or time- 
varying weighting coefficients /fi, Ajg. and /C4, which permit control the influence of the echo path similarity error vec- 
tors in Method (2-b-2), into Eq. (84) of Method (3-b) as follows: 



20 



25 



30 
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40 



45 



x;''»"(k) Xj'''^''(k) 0 



.(P,)T 

1 

0 
0 



2 (k) x;' 

0 
0 



(P',)T 



(k) 



0 
0 



X 



A h ii(k) 
A h2i(k) 
A hi2(k) 
A h 22(k) 
A f i(k) 



.A f2(k) J 



0 0 
Jc,v,X^''''^''(k) -ic^v^X^'^'^Ck) 
0 0 



(p,) 



(k) 



V, { t%'^ (k)-C,(k) e^V^ (k) }+ w,C,(k) e^^'* (k) 



V, { e";'^^ (k)-Cj(k) t%^^ (k) j+WjCjCk) 00 



SO 



55 



Method (3-b-2) 

It is also possible to obtain the adjustment vectors by introducing weighting coefficients A,^ and into Eq. (93) as 
follows: 
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X^'^dc) X?'»>) 0 0 
X^'^^dc) xi'V^k) 0 0 



0 0 



0 0 
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0 
0 



0 
0 



X^^^k) X^^^^k) 



.(P'2>T 



(k) 



Xr^'^k) IC3V^X;''VT(k) ^^v^x?'^>^k) 



X 



A h ii(k) 
A h2i(k) 
A h i2(k) 
A h 22(k) 
A f i(k) 



A f2(k) 



^.v, { e^l''(k)-C,(k)e'^'\k)} + w,C,(k)e*'; 



'*(k) 



e^^'(k) 



^2V, { e^^^ (k)-C,(k) e^;^^ (k) } +w, C,(k) e<?\k) 



(95) 

35 andby controlling the weighting in accordance with the balance between the weighting coefficients k^. k^. and 
l\1ETHOD4 



40 



4S 



SO 



In the various methods described above, an ES (exponentially weighted step-size) algorithmcan be further applied 
w,* whrch rt .s p^,ble to provide different adjustment weighting coefficients tor each tap on theSsifrt tS 
tial decay property of rmpulse responses of the echo path. « uasis oi ine exponen 

For example, setting Eq. (33) in Method (1-a) as follows: 



M(k) = 



x'I(k) x'J(k) 



(96) 



Eq. (33) becomes as follows: 



ss 


M(k) 


A h lm(k) 












. A h 2n,(k) . 




y' 

HI 





(97) 



The minimum-norm solution of this simultaneous equations is given by 
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A h im(k) 

A h 2m(k) 



= M^(k) [M(k)M^(k) +6l] 



-I 



r^e (k) 

/m^' (k) 



(98) 
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where I is a unit matrix and 6 is a small constant for stabilizing the inverse matrix operation. To apply the ES algorithm 
to the above equation (98). a basic exponential decay matrix A^^) is prepared which is expressed by 



^ 1 



0 



^ (r) 



(99) 



where: 



<x^'\x^'Y\\=1 L 



(100) 



30 Alternatively. L sequences of numbers given by Eq. (100) are divided into equally or unequally spaced blocks and the 
value of each a^j in each block is made equal to the value of the first a^'')-, in the same block, by which the basic expo- 
nential decay matrix is obtained in a simplified form which has an advantage in terms of computational complexity. 
The matrix is set as follows: 



35 



A = 



A<'> 0 
0 A<^> 



(101) 



40 



This is applied to Eq. (97) as follows: 



45 



A h im(k) 

A h 2n.(k) 



= AM \k) [M(k)AM ^(k) -f 6l] " ' 



(102) 



From the minlmum*norm solution thus obtained, the adjustment vectors of the respective estimated echo path vectors 
50 are derived. 

Similarly, If the following equation is set for Eq. (82) In Method (3-a) employing the afbre-mentioned projection algo- 



rithm 
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M(k) = 
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IS 



xf'^^k) xr''^\k) 0 

0 0 
0 



0 -^,Y'.xf '^^(k) -.c.Y'.xf V^Oc) 

0 



x;''^>^k) x^'V) 0 

0 xr^'-^Ck) X^>\k) .3Y'2X^^\k) .,Y'aXr^^'^<k) 

(103) 



£10 Eq. (82) becomes as follows: 
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M(k) 



A fi'ii (k) 




A ^2t (k) 




'v.e^^k) 




A ^12 (k) 




Y'. e?''\k) 




A &22 (k) 




Y2e^\k) 


(104) 


A f , (k) 




.Yae^'^^k) 




A f 2 (k) 





The minimum-norm solution of this simultaneous equations is given by 
A h 11 (k) 
A fi'21 (k) 
A h ,2 (k) 
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A h 22 (k) 



A f 1 (k) 



A f 2 (k) 



= MT(k)[M(k) M'^ (k) + dl]-' 



y. e?'^k) 
y'.ef'^k) 



Y2 e 



'''' (k) 



(105) 



mafrK^r ^ ^' generated which is composed of the basic exponential decay 
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This is applied to Eq. (104) as follows: 
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A 


hu (k) 


A 


^21 (k) 


A 


hi2 (k) 


A 


^22 (k) 


A 


f 1 (k) 


A 


f 2(k) 



= AM"^ (k) [m (k) AM"^ (k) + 6l] * 



Yie?>^k) 



Y'le^^^^Ck) 
Y2e^\k) 



(107) 



The minimum-norm solution thus obtained Is used to obtain the adjustment vectors of the estimated echo path vectors. 
It is apparent that the ES algorithm can similarly be applied to the other methods, and no description will be given of 
them. 

As described above, according to the multi-channel acoustic echo cancellation method of the present invention, 
unknown input*output relationships between imaginary inputs In the case where some or ail of the multi-channel 
received signals are exchanged and then reproduced as acoustic signals from channels different from their original 
channels and imaginary outputs which ought to be obtained when the imaginary inputs are observed as echoes by 
microphones after propagating over the corresponding echo paths are obtained approximately. The approximated 
irput-output relationships and input-output relationships, which are observed when received signals of respective chan- 
nels are reproduced intact as acoustic signals and are picked up by microphones after propagation over the corre- 
sponding echo paths as in the prior art, are both evaluated to obtain the adjustment vectors of the estimated echo 
paths-this speeds up the estimation of the true echo path in the echo path estimating part. 

45 Echo Canceller 

Next, exanples of the echo cancellers embodying the above-described methods of the present invention will be 
described in comparison with conventional device configurations. The conventional echo cancellation system having an 
N-receive-channel system and an M-pickup- channel system Is formed by providing N-channel echo cancellers 22^, 
222 22m independently of M pickup channels as shown in Fig. 2. In contrast thereto, according to the present inven- 
tion, the echo cancellation system with the N-receive-channel system and the M-pickup-chamel system is formed as 
an NxM channel echo canceller 23 as depicted in Fig. 7. which is adapted to exchange information between channels 
and make the echo path estimation as shown in detail in Fig. 8. 

The configuration of the echo canceller shown in Fig. 8 is the basic configuration that is applicable to any of Meth- 
ods 1 to 4 of the present invention, and as will be described below, this configuration features a vector permuting/com- 
bining part 41 in comparison with the echo path estimating part 19„ in the prior art example of Fig. 3. In the vector 
computing/combining part 41. the received signal vectors x^{k), XgCk). ... are arranged in D ways by rearranging them 
through their exchange with received signal vectors of other channels, and these vectors are combined into D vectors 
x<^)(k), x(2)(|^, ... xPkk). By approximating the input-output relationships for the combined vectors x<^)(l^, x<2)(k), ... 
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xff')(k) through use of the similarity of echo paths. esHmated echo path adjustment vectors Afi,(W ... a can 
be obtained. " . "■■M\tv/«in 

The NxM channel echo canceller has N received signal storageA^ector generating parts 1 7, to 1 7. corresponding 
to N channels as 8ho«m in F|g. 8. which hold L received signals up to the current time (k) determined fbr the rSpectivl 
received signal channels and generate the received signal vectors x,(k) to XN(k) expressed by <7) to (9) aste the 
case With the rec^ved signal storageA^ector generating parts 17, to 17, in F^. 3. ^e recelvil SnS?vS:SL K,^k) to 
XN(^thus obtained are combined by a vector combining part 24 into the combined vectors x(k) expressed by €a (10) 
which are providedtoecho replica generating parts 18, to is^. Tine echo replica generating part 18„ (wherem^.. M) 
fweadim-th pickup channel calculates an echo replica by Eq. (13) from the combined vector x(k) and the combined 
estimated echo path ve^or h (k) and provides the echo replica y„(k) toasubtractor21„. Each subtracter 21 „ outputs 
the difference behveen the echo y„(k) and the echo replica y„(k) as the residual echo (l.e. an em>r signal) eZw 

compubng/oombining part 41. which rearranges the N-channel received signal vectors Xi(k) to xUk) in D ways by 
exchanging the recen^ed signal vectors of the respective channels, then combines the received signaJs of the D ordeis 
of a-^ngement into D combined vectors x(i)(k). x<2)(k). ;.. x(^)(k) by Eq. (10) as is the case with SiTv^oPLnSnZJ 
^ fj IT r^ a ''^'^ *° estimating part 19. The echo path estimating part 19 te 

supplied wrth the D comb,n«l vectors xO)(k) to x<c»(k), the combined vector x(k) fram the vecS^combining^^24 the 
error signals ei(k)to from the 8ubtractors21 1 to 21 „ and. if necessary, the echoes y,(k) to yM(k) as indicated by 
the broken lines. The echo path estimating part 1 9 calculates the estimated echo path adjiSment vS<is Ah WW 7 
AhM(k) by any one o the afore-mentioned methods and furtiier calculates the estimated echo path vectors ft.(k+i) to 
hM(k+1) at the next time (k+1) by Eqs. (29) and (30), for instance. iv^*i;io 
I?' block diagram of the echo path estimating part 19 for use in the execution of the afbre-men- 

loned mettiods d-a). (2-a-1 . ^-a^). (2*-10. (2-b-2) and<3-a) which involve assigning the coeffteients y„ and y^to 
the error sigrials e,(^and e (k). The combined vectors x(i)(k) to x<D)(k) from the vector permuting/combining piT24 
aSgUfn^rt' ife afwS. """^''^ *° adjustment vector calculating part 19A and a weighting coefficient 

A weighting coefficient control part 19E introduces, by Metiwd (1-a), the weighting coefficients y„ and y' into the 
""^"It^^"!^^!™*** Snput-output relationships, respectively, then changes the weighting coefTfcienJin accord- 
ance withthe degree of conveipence of ttie estimated echo path vector to the true echo path and provides the weighting 
co^icienls to weighting coeffident assigning parts 19B. 19C and 19D. That is. the weighting coefficient contr^ part 
^^"^ • ^ ^^^^"^ tt^eecho^yj(k) to yM(k) together with the error signals e,(k) toeM(k). then caSi- 
latesttieir average power ratK> r p^^ly^jligi as an index representing the degree of convergenc; of the eS- 

mated echo path vector and. based on the value of tiie index, determines the weighting coefficients y„ and V The 
weighting coeffident in Eq. (33), (70), (73). or (82) is always set at 1. for instance, and when the pJwrer ra«o r«„ 
be<»mes larger ttmn a predelemiined positive value r.^, the weighting coefficient y„ is set at a predetermined lar^ 
posrt ve value which does not exceed 1 . and when the power ratio rp„ is equal to or smaller than the predetemiined 
fwsitove value rjh, ttie weighting coefficient y„ is set at a predetermined small positive value which does not exceed 1 
eithen A weighting coefficient evaluation and cortrd part 19Q is used in ttie case of IViethod (2-b-2) it detennines 
based on ttie adjustment vector Af(k). the weighting coefficients k„ ftg, ftg and for controlling the influence of ttie 
echo patti simitenty eiror vector Af and provides ttie weighting coeffkHents to ttie weighting coefffoient assigning part 
1 9B. The weighting coefficient assigning part 1 9B assigns ttie received signal vectors xT and k5 with weighte by com- 
binations of the weighting coeffidfents /r, to &4 and y,. yg as shewn in Eq. (66) and provides ttiem to the adjustment 
vector calculating part 19A. The weighting coeffidenls assigning parts 19C and 19D assign tfie weighting coefficlenls 
Y^ . Ys and n . Ya to ttie error signals e, (k) and e2(k) and provkle ttiem to the adjustment vector cateulating part 1 9A The 
adjustinent vector calculating part 19A uses tfie signals applied ttiereto to solve any one of Eqs. i33) {70) (73) and 
(84), thereby obtaining the adjustinent vector Aft„„(k), whtoh is provided to an adaptive filter updating part 19F The 
adaptive fUter updating part 19F adjusts ttie estimated echo patti vector by Eqs. (29) and (30), ttien outputs it as ttie 
estimated echo patti vector at time (k+1) and provides it to each of ttie echo replica generating parts 18, to 18m 

Fig. 10 IS a functional block diagram of a multi-channel acoustic echo canceller which embodies ttie afore-men- 
tioned Methods (1-b). (2-a-3), (2-b-3), (3-b-l) and (3-b-2) which separate ttie error signal e'„(k) into components and 
weight them witti the coefficients v and w. In ttiis example, as in the Rg. 9 example, the weighting coefficient evalua- 
tion/control part 19G uses ttie adjustinent vector Afi(k) to determine ttie weighting coefficients to k^ which controls 
ttie "ifluerice of the echo path similarity enor difference Af (k) and provides ttiem to ttie weighting coeffident assigning 
part 198. The adjustment vector .calculating part 19A is supplied witti ttie combined received signal vector X(k) and 

channel-exchanged combined received signal vectors K(iO)(k) )C<D)(k). In this embodiment, ttie error signal e'Jtki is 

divided into a component correlated witti ttie error signal e^(k) and ttie ottier component and they are assigned vJith ttie 
weighting coefficients wand V, respectively as shown in£q. (39).<74).<84). (94). or<95). Tofliisend. as is the case witti 
!Lf^'/Lx!u*'^^**'"° coeffident control part 19 g catoula tes from ttie echoes y,(k) to y,M and ttie error signals 
eiOO to eM(k)ttieir average power ratio rp„=|y„(k)|'^/ji;;wi* as an index indicating ttie degree ofconver^ence of ttie 
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estimated echo path vector, and determines the values of the coefficients w and v accordingly. Furthermore, a cross- 
correlation calculating part 19H calculates the cross-correlation between the received signals by a matrix 
c(k)sr-(k)r '\k) or Ci(k) and C2(k) In Eqs. (86) to (89) and provides It to a component separating part 19J. 

The corrponent separating part 19J separates the en-or signal e m(k) into the component correlated with the en-or 

5 signal eni(k) and the uncorrelated component, which are fed to weighting coefficient assigning parts 19K and 19L and 
assigned with the weighting coefficients w and v, respectively. The con-elated component and the other component 
assigned with the weighting coefftoients are added by an adder 19M and the added output is applied to the adjustment 
vector calculating part 19A. The adjustment vector calculating part 19A uses the signals applied thereto to solve the 
simultaneous equations (37), (74), (84), (94), or (95) to calculate the adjustment vector A h(k), which is provided to the 

10 adaptive filter updating part 19F and the weighting coefficient evaluation/control part 19G as well. Based on the adjust- 
ment vector provided thereto, the adaptive fflter updating part 19F calculates the estimated echo path vector by Eqs. 
(27) and (30) and outputs it. 

Fig. 1 1 illustrates the functional block configuration of the adjustment vector calculating part 19A in the echo path 
estimging part 19 of Figs. 9 and 10 which permits the application of a p-th order projection algorithm of Method 3 and 

IS the ES algorithm of Method 4 when the echo paths are highly symmetrical and hence Method (2-a) is used. To execute 
the p-th order projection algorithm, the received signal vectors are provided to a signal storage part 19A2, wherein (p- 
1) preceding received signal vectors are held, and the received signal matrix X<P>n of Eq. (85). which is a set of the 
stored received signal vectors and the received signal vectors at the current time k. is fed to an exponential weighting 
coefficient assigning part 19A1 , wherein the received signal matrix is assigned with a weighting coeffident by the basic 

20 exponential decay matrix A^, thereafter being provided to a simultaneous equation calculating part 1 9A3. At the same 
time, the received signal vector weighted in the weighting coeffk^ient assigning part 19B in Figs. 9 and 10 is also pro- 
vided to the simultaneous equation calculating part 19A3. 

On the other hand, the weighted measured error signals ei(k) eM(l^ and the weighted approximated en-or sig- 
nals e'i(k), .... e M(k) are also stored as sets of error signals at (pp-l) previous points in time and they are applied to the 

25 simultaneous equations calculating part 19A3 together with en-or signals at the current time. The simultaneous equa- 
tions calculating part 19A3 solves the simultaneous equations (47) from tiie signals fed thereto to calculate the adjust- 
ment vector Ah(k). In the case of Fig. 10. tiie set of measured en-or signals e-^ik) ei^{k) at (Pn-1) previous times are 

stored In the signal storage part 1 9A4 and are provkJed therefrom to the simultaneous equations calculating part 19A3 
together with the set of measured error signals at the current time and the set of component-separated, weighted 

30 approximated en'or signals from tiie adder 19M is provided to tiie signal storage part 19A5, wherein a set of weighted 
approximated error signals at (Pp-I) previous times is held. The (Pn-1) sets of weighted approximated en-or signals and 
the set of en-or signals at the current time are fed to the simultaneous equations calculating part 19A3. The simultane- 
ous equations calculating part 19A3 uses these signals to solve, for example, Eq. (74) to obtain the adjustment vector 
Fig. 12 illustrates the functional block configuration of tiie adjustment vector calculating part 19A which is used In 

35 the echo patii estimating part 1 9 of Figs. 9 and 1 0 in the case of calculating the adjustment vector by Method (2-b) , tak- 
ing into account low symmetry of the echo path (i.e. The similarity error). Also in tills case, the adjustment vector calcu- 
lating part 19A Is adapted to execute the p-th order projection algoritiim of Method 3 and the ES algorithm of Mettiod 
4. This embodiment differs from the Fig. 1 1 embodiment In that the simultaneous equations calculating part 19A3 cal- 
culates tiie adjustment vector by solving any one of the simultaneous equations (69), (70), (73), (82), (84). (94) and (95) 

40 containing the similarity error difference At and that a signal storage part 19A6 and an exponential weighting coefficient 
assigning part 19A7 are provided also for the received signal vectors assigned w'rth tiie weighting coefficients by ttie 
weighting coefficient evaluation/conti^ol part 19G in Rgs. 9 and 10 for confrolling the influence of the similarity en-or dif- 
ference vector Af (k). This embodiment is identical in construction witii the Fig. 1 1 emtjodiment with respect to the other 
remaining points, of which no description will be repeated. 

45 

EFFECT QF THE INVENTION 

This invention method can be used for echo cancellation in the realization of a teleconference system of highly real- 
istk: presence which permits transmission of acousto-spatial information between two points by tiie use of a multi-chan- 

so nel transmission system and terminal equipment provided with multi-channel pickup and receive systems. 

For the sake of brevity, conskler a stereo teleconference system which connects two points via a two-channel trans- 
mission system and uses two-channel pickup and receive systems as shown in Fig. 4. For example, when a plurality of 
speakers speak in tiieir seats at tiie point A. stereo speech signals which are picked tp by two mtorcphones bear a 
cross-con^elation therebetween dependent on the positional relationship between the speakers and the microphones. 

55 When these speech signals are reproduced at the point B using the conventional echo canceller, ttie echo estimation 
depends on the cross-conelation between the speech signals and hence is Incon-ect, allowing large echoes to return 
to the point A each time the speaker changes. In contrast to this, ttie echo cancellation method of the present invention 
is capatrfe of lessening the influence of the cross-con-elation between the stereo signals and quickly estimating the echo 
patii. and hence suppresses echoes from increasing whenever tiie speaker changes. Fig. 13 is a graph showing the 
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results of computer simulations using, as reproduced signals, stereophonically picked up speech uttered Ijy a speaker 
with his t)ody or head fixed. The prior art method (a), a method of extracting a variation in the cross-correlation <b) pro- 
posed in the inventors- prior application (Japanese Pat Appln. No. 50002/95), and this invention method <c) are com- 
pared in ternis of the error vector between the combined estimated echo path vector generated in the echo path 
estimating part and the combined true echo path, with the echo path estimation starting time set at 0 An NLSM (Nor- 
malized Least Mean Squares) algorithm was used in the case of the conventional method and a second-order projec- 
tion algonthm was used in the case of the method by the extraction of a variation in the cross-correlation proposed in 
the prior application. In the case of this invention method, the adjustment vector was calculated by €q (107)- the 
weighting coefficients yi. Vi. yz and were made time-varying in accordance with the echo return loss enhancement 
(ERI^. /f,=/r2-fr3=/Q»-1.0. p,=p^=p2=p-2=2. A(1)=A(2)=A(3)=aW=^^^^^ 

assigned with weights 1 .0. 0.5. 0.25 and 0.125. As is evident from Fig. 13. according to this invention method, the echo 
path en-or vector decreases faster than in the cases of the other methods and the vector itself is also smaller. 

Rg. 14 is a graph showing the influences of the weighting coefficients y, and y2 with the coefficients n and set 
at Yi-Tz-O m this invention method using Eq. (70). The curve (a) indicates the case where yi=y'2=1 0 and the curve (b) 
the case where yi=Y2=0.5. A comparison of these curves indicates that appropriate values of the weighting-coefficients 
y, and differ with the convergence of filter coeffidents. Then, the values of the weighting coefficients y, and y, were 
changed with ERLE. that is. ERLE was large the coefficients y, and iz were set small; in this case, the characteristic 
was improved as indicated by the curve (c). Further, the ES algorithm based on the exponential decay characteristic of 
the impulse response was used, in which case the curve (d) was obtained. This is considered to be due to the fact that 
since this invention method approximately utilizes the unknown input-output relationships expressed by Eqs (55) and 
(57). the approximation accuracy is inproved by the use of the statistical property of the impulse response. ' 

Fig. 1 5 shows the convergence characteristics of the echo path estimation which were obtained when this invention 
method {3-b) was used under the same conditions as in the case of Rg. 14 and the following coefficients were made 
time-invariant in Eq. (84) . 

The curve (a) indicates the case where vi=v2=0. wi =W2=1 . Pi=p'i=P2=p'2=1 and ^L^^^.5. thecurve^b) the case 
where vi=V2=l. Wi=w2=l. pi=p-,=p2=p'2=8 and m,=^2=0 05. the curve (c) the case where vi=v2=0. w.-wo^l. 
Pi^ i=P2=P'2=8 and fti=|i2=0.05. the curve (d) the case where Vi=V2=0. Wi=W2=0. Pi=p',=p2=p'2=8 and jti=^2=0.05 
and the curve (e) the case where vi=V2=1. Wi=W2=0. Pi=p'i=p2=p2=8 and »i,=H2=0.05. As will be seen from Fig. 15. 
since this invention method (3-b) uses the weighting scheme of the method (1-b). the error dDtained concerning the 
approximated input-output relationship can be evaluated excepting therefrom the error obtained concerning the observ- 
able input-output relationship or a r«dunctent component as in the case of the curve (e) in Fig. 15; hence, good results 
can be otrtained without varying ttie weighting coefficients with time as in the c»es of Rgs. 13 and 14. 

example of Application 



Other than the method according to which at a terminal provided with a stereo receiving system, two-channel 
stereo signals picked up at the other end are received and reconstructed intact, there is proposed a mefriod for multi- 
point teleconference by which the received signal for each point is freely subject«l to sound image localization at the 
receiving side to provide a comfortable receiving environment. The method and apparatus according to the present 

40 invention are also applicable to such multi-point teleconference terminals. Rg. 16 illustrates the configuration of a four- 
point teleconference system. At each point the pickup system is one-channel (monaural). Now. the teleconterence sys- 
tem will be described in connection wHh the point D. Let it be assumed that at the point D received signals from the 
points A. B and C are subjected to sound image localization so that the signals are k}caliz«l at the right, center and left 
with respect to the point d. respectively, by which new two-channel stereo reproduced signals are generated for two- 

4S channel stereo reproduction. In this instance, a response yi(k) to the two-channel receiv«i signals x,(k) and x,(k) at 
some point is given as fblkjws: i £\ ' 



y , (k) = h]i (k) H , (k) + hJi (k) (k) (108) 
By applying the echo path similarity error vector f,(k) between hTi (k) and h J, (k). the following equation is obtained: 

K (k) - hi (k) = If, (k) (109) 

Then, the response yi(k) which is obtained when the reproducing channels of the received signals x1<k) and afidd are 
exchanged is given as fbUows: 
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y', (k) = h}, (k) X2 (k) + hj, (k) X , (k) 

= y, -fT(k)x,(k) + f|(k)x2(k) (110) 



By formulating simultaneous equations based on Eqs. (108) and (110). it is possible to obtain an estimated echo path 
vector adjustment equation according to this invention method. 

10 Generally speaking, in the application of the conventional echo cancellation method to a teleconference system 
composed of a multi-receive-channel system and a pickup system of one or more channels, the echo path estimation 
is not correctly made when the received signals of the respective channels have a high cross-correlation; therefore, the 
echo increases upon each variation in the cross-correlation between the received signals. This invention method uti- 
lizes, in addition to the input-output relationships based on multi-channel received signals bearing a fixed cross-corre- 

15 lation, approximated input-output relationships based on multi-channel signals bearing a cross-correlation different 
from the above-mentioned one. That is, an unknown output is approximated which ought to be produced by each micro- 
phone that picks up acoustic signals reproduced from channels different from their originals when some or all of the 
mutti-channei received signals are exchanged. Since the echo path estimation is made by solving simultaneous equa- 
tions concerning these input-output relationships, its solution does not become indefinite, and hence such problems as 

20 described above can be reduced. 

It will be apparent that many modif icattons and variations may be effected without departing from the scope of the 
novel concepts of the present invention. 

Claims 

25 

1 . A multi-channel acoustic echo cancellation method comprising the steps of: 

(a) radiating received signals of a plurality of channels as acoustic signals by a plurality of loudspeakeis 
respectively corresponding thereto; 
30 (b) picking said acoustic signals from said plurality of loudspeakers up by each microphone after propagating 

over respective echo paths to obtain an observable echo; 

(c) storing said received signals of said plurality of channels for predetermined periods of time and forming 
received signal vectors by said stored received signals for each channel; 

(d) combining said received signal vectors in all the channels into observable combined received signal vec- 
35 tors; 

(e) providing said combined received signal vectors to estimated echo paths having combined estimated echo 
path vectors which converge to confined vectors of the echo path vectors represented by impulse responses 
of the respective echo paths, whereby is generated an echo replica simulating said observable echo, said com- 
bined received signal vectors and said corresponding echo conresponding to said observable irf>ut-output rela- 

40 tionships of said plurality of echo paths; 

(f) sii^tracting said echo replica from said echo to obtain a residual echo; 

(g) calculating an approximated echo replica in the case where combined exchanged received signal vectors, 
obtained by exchanging at least two received signals of said plurality of channels, are provided to said esti- 
mated echo paths; 

45 (h) approximating an echo which ought to be obtained by each microphone when said received signals 

exchanged as in step (g) propagate thereto over said plurality of echo paths; 

(i) substracting said approximated echo replica from said approximated echo to obtain an approximated resid- 
ual echo; 

Q) evaluating obsen^abte input-output relationships representing the relationships between said observed com- 
so bined received signal vectors and said corresponding observable residual echo and approximated input-output 

relationships representing the relationships between said combined exchanged received signal vectors and 
said approximated residual echo and obtaining said adjustment vector based on the evaluation; and 
(k) adjusting said estimated echo path vector by said adjustment vector. 

55 2. The method of claim 1 . wherein said step (j) includes a step of weighting at least one of saki approximated input- 
output relationships and said observable input-output relationships in their evaluation. 

3. The method of claim 2, wherein said weighting step includes a step of multiplying, by time-invariant or time-varying 
coefficients, residual echoes which are differences between echoes conresponding to the outputs of said approxi- 
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mated and observable input-output relationships and echo replicas which Emulate them. 

4. The method of claim 2. wherein said weighting step includes a step of «eparating said approximated residual echo 
into a component correlated with said observable residual echo and other component and multiplying said compo- 
nents by time-invariant or time-varying coefficients independently of each other. 

5. The metliod of claim 4 further comprising a step of calculating said approximated input-oulput relationships 
through utitzaton of said actually observable known Input-output relationships, said observable residual echo for 
use m the evaluation of said known input-output relationships and the similarity between said plurality of echo 
paths and on the assumption that similar echo paths are formed between loudspeakers and microphones similar 
in such physical positional relationships as the distances between them and their directions or orientations intro- 
ducing a difference in said similarity as an echo path similarity en-or vector, and calculating said estimated echo 
path adjustment vector by a projection algorithm through the use of said approximated input-output relationshios 
said obsen«ble input-output relationships and their past input-output relattonshiss. *' 

6. The method of claim 5. further comprising a step of introducing a weighting coefficient which makes it possible to 
control the influence of said echo path similarity error vector. 

7. The method of claim 2. 3. or 4. further comprising a step of determining, for each operation time, the value of said 
weightng coefficient through utilization of at least one of the ratio between said echo and said residual echo the 
average power ratio between said echo and said residual echo, the absolute value of said residual echo and the 
average power of said residual echo. 

8. The method of claim 1, further comprising a step of calculating said approximated input-output relationships 
through utilization of said actually observable known input-output relations, a residual error signal for use in the 
evaluation of said known input-oulput relationships and the similarity between said echo paths. 

®" ^ llf*^ °! '^T 2. further comprising a step of calculating said approximated input-output relationships 
through utilization of said actually obsen«ble known Input-output relations, a residual error signal lor use in the 
evaluation of said known input-output relationships and the similarity between said echo paths. 

1 0. The method of daim 4. further comprising a step of cateulating at least one of the ratio between said echo and said 
residual echa the average power ratio between said echo and said residual echo, the absolute value of said resid- 
ual ect» and the average power of said residual echo, determining the state of convergence of said residual echo 
on the basis of said calculated value, and when the state of convei^ence of said residual echo is bad setting the 
weighting coeffiaent for said correlated component at a predetermined value except 0 and the weightingcoefficient 
fcjr the other remaining component at 0. and when the state of convergence is good, setting eaid weighting coeffi- 
aents for both of said components at predetermined values including 0. 

11. The method of claim 8. further comprising a step of calculating said estimated echo path acfjustment vector by 
using said approximated input-output relationships, said observable input-output relationships and their past input- 
output relationstiips. *^ 

12. The method of dalrni 1. further conprising a step of using said past input-output relationships through utilization 
of a projection algorithm. 

13. The method of daim 8. 9. or 1 1, further comprising a step of utilizing said echo path similarity on the assumption 
that similar echo paths are formed between loudspeakere and microphones similar in such physical positional rela- 
tionships as the distances between said loudspeaker and said microphones and their directions or orientations. 

1 4. The method of daim 4. 8. 9. or 11 . further comprising a step of introducing the difference in said echo path similarity 
as an echo path similarity en-or on the assumption that similar echo paths are formed between loudspeakere and 
microphones similar in such physical positional relationships as the distances between them and their directions or 
onentatkxis. 

1 5. The method of claim 1 4. further comprising a step of introdudng a weighting coeffiaent which makes it possible to 
control the influence of said echo path similarity error vector. 

IS. Themethodofdaim8.9.or11.furtherconprisingastepofapplyinganexponentiallyweighted«lep-si^^ 
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which provides a different adjusted weighting coefficient for each tap on the basis of the exponential decay property 
of impulse responses of said echo paths in the calculation of said estimated echo adjustnnent vector. 

17. A multi-channel acoustic echo canceller comprising: 

a plurality of loudspeakers for radiating received signals in a plurality of channels into acoustic signals and for 
outputting them; 

at least one microphone connected to at least one transmission channel, acoustic paths for said acoustic sig- 
nals from said plurality of loudspeakers to said microphone forming echo paths and said acoustic signals 
picked up by said microphone and combined into an echo for input into said transmission channel; 
a received signal vector generating part for temporarily storing said received signals of said plurality of chan- 
nels and for generating each received signal vector; 

a vector combining part for combining said received signal vectors of said plurality of channels into confined 
received signal vectors; 

an echo replica generating part supplied with said combined received signal vectors and combined estimated 
echo path vectors simulating said combined echo path vectors obtained by combining echo path vectors rep- 
resenting impulse responses of said echo paths from said plurality of loudspeakers to said microphone, for out- 
putting an echo replica simulating said echo; 

a subtracter for subtracting said echo replica vector from said echo output from the microphone and for output- 
ting the difference as an observable residual echo; 

a vector permuting/combining part for generating combined rean-anged received signal vectors obtained by 
combining said received signals of said plurality of channels after reananging at least two received signals of 
said plurality of channels: and 

an echo path estimating part supplied with at least said combined received signal vectors and said observable 
residual echoes corresponding thereto, for obtaining approximated echo replica in the case of applying each 
of said combined received signal vectors to one of said estimated echo paths, for obtaining, as an approxi- 
mated echo by approximating the inputs into said plurality of echo paths, an unknown echo to be obtained from 
said microphone in the case of said received signals being exchanged, for subtracting said approximated echo 
replica from said approximated echo to obtain an approximated residual echo, for evaluating an observable 
input-output relationship representing the relation between sakl combined received signal vector and said 
observable residual echo con-esponding thereto and an approximated input-output relationship representing 
said reananged combined received signal vector and said approximated residual echo con-esponding thereto, 
for obtaining said adjustment vector on the basis of the evaluation, for generating an estimated echo vector 
obtained by adjusting said estimated each path vector with said acljustment vector, for providing it to said echo 
replica generating part. 

18. The echo canceller of claim 1 7. wherein said echo path estimating part comprisiss: 

residual echo weightig means for weighting saki observable residual echo and sakJ approximated reskJual 
echo relative to each other; 

an adjustment vector calculating part for calculating said adjustment vector on the basis of the relationshps 
between said combined received signal vector and said rean-anged received signal vector and between saki 
observable residual echo and said approximated residual echo; and 

an adaptive filter updating part for adjusting said estimated echo path vector by said adjustment vector and for 
providing saki adjusted estimated echo path vector to said echo replica generating part. 

19. The echo canceller of claim 17, wherein said echo path estimating part further comprises: 

component separating part for separating sakj approximated residual echo into a component con-elated with 
said observable residual echo and other non-correlated component; and 

weighting means for weighting saki correlated component and said non-correlated conrponent relative to each 
otiier. 

20. The echo canceller of daim 19, wherein saki echo path estimating means further comprises cross-correlation cal- 
culating part for calculating tine cross-correlation of said rearranged received signal vector with saki received signal 
vector and said conrponent separating part comprises means for calculating the product of said cross-con-elation 
calculated by said cross-correlation calculating part and saki observable residual echo as saki component of saki 
approxinfiated residual echo which is correlated with saki observable reskiual echa 
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21. The echo canceller of claim 18 or19. wherein said echo path estimating part further comprises a weighting coeffi- 
cient control part for calculating, at each operation time, at least one of the ratio between said echo and said resid- 
ual echo, the average power ratio between said echo and said residual echo, the absolute value of said residual 
echo and the average power of said residual echo as an index representing the state of convergence of said 

5 observable residual echo and for controlling said weighting coefficients on the basis of said calculated value. 

22. The echo canceller of daim 18 orl9. wherein said echo path estimating part further comprises a -similarity error 
weighting part for assigning said received signal vector with a weighting coefficient fbr controlling the influence on 
said residual echo by a similarity error difference vector which is a difference between a similarity en-or vector 

10 between similar echo paths and a similarity en'or vector between said estimated echo paths con^esponding to said 
similar echo paths. 

23. The echo canceller of claim 18 or 19. wherein said adjustment vector calculating part comprises a signal storage 
part for storing said received signal vectors, said rean-anged received signal vectors and said residual echoes at a 

IS predetermined number of previous points in time going back from the current time, and a simultaneous equations 
calculating part for obtaining said adjustment vector by solving simultaneous equations through utilization of the 
relationships among said received signal vectors, said rearranged received signal vectors and said residual echoes 
at said previous points in time from th^ current time and said adjustment vector. 

20 24. The echo canceller of claim 22. wheran said adjustment vector calculating part comprises a signal storage part for 
storing said received signal vectors, said rearranged received signal vectors and said residual echoes at a prede- 
termined number of previous points in time going back from the current time, and a simultaneous equations cakuj- 
lating part for obtaining sakl adjustment vector by solving simultaneous equattons through utilization of the 
relationships among said received signal vectors, said rearranged received signal vectors and said reskJuai^hoes 

25 at sakJ predetemriined number of previous points going back from said current time, saki adjustment vector and 
sanl similarity error difference vector. 

25. The echo canceller of daim 23 or 24. wherein said adjustment vector calculating part furtfier comprises an expo- 
nentially weighting means fbr weighting said received signal vectors and said rean'anged received signal vectors at 
30 sakJ predetermined number of previous points going back from said current time by exponential decay coefficient 
vectors of tiie same numbers of elements as ttiose of said received signal vectors and sakl rearranged received 
signal vectors, and sakJ simultaneous equations calculating part uses an exponentially weighted step-size algo- 
rithm to calculate sakf acQustment vector. 
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